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Abstract of JP10083632 

PROBLEM TO BE SOLVED: To continuously reproduce a video and a sound without collapsing a decoding buffer in changing a 
plurality of multiplexing streams to be reproduced. SOLUTION: The size of access units for three kinds of video streams VS0 , 
VS1 and VSw is detected individually by their respective access unit detectors 52a, 52b and 52c, and the max. access unit size 
is detected by a max. value detector 53, and this is regarded as an access unit for a virtual video stream. Packetizing control 
information is sent by a scheduler 54 to packetizer 55a, 55b and 55c respectively based on information of this virtual video 
stream and other elementary streams to be multiplexed, and packetization is performed by multiplexing the elementary streams 
for each of the actual video streams VS0 , VS1 and VS2 . 
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(57) [g^J] 

[ism] am©^aYb^ h v-Azwvmz-Tm^-t 

VS 2 ©T^-fe^^--^ hCDAS$S:-en-?'tl7'^-feX 
^.-v MMi§§5 3 a, 5 3 b, 5 3 c Tt&tBU f^ffilt 
fcBg§5 3T-i^®7^t^a--y hlf X£t&tt! IT, 

— Ai:flii©^Mfb-r^§3iix^ >^ y— ^ h y— A©tf 
5 5a, 5 5b, 5 5c KTigD, IBCCr^ h 'J-AV 

So, vs., vs 2 «tflii©^^^ >^ y— ^ h y— At 




(2) 

1 

[!ff*if 1 ] 7 s t?9Jbm*<D\£v bX b 'J-AS^Ff 

mm<Dz?j VtMm^Wv bX b 'J-A5S«t5x 
It, 

IMWk^-l V^Mm^(D\iv bX b U— 

bX b >)-A(Dmi&<D7i?-bX3-~y b©*#££ltigt 10 

#5 I 3-b*^iJtr43V^'r7'^-fe^JL-^ b©;*:^;**^ 
i33fft£*x;feft;*:{iifc^ b<^5id £{g:®x b U - A 

±lffl*«©5 s 'f 5>*;HB^«DK<s» bX b 'J-ASIWft 
-rsWC* ±13^*^3.= v b#±B3{KS!x b 'J— A 

-f v J ^MS-^-©tT>y bX b U— A©T^-feX:i— i> b© 
*£&i:±§3<5SX b U— A©7^-feX^-->.y b©*t 
£i:©M#£*fbT, ;^r>f>WybS«^^^ 20 
y b'fb-rsn:gi:^#-rS3i:*i|te»i:t-S7 i 'f 5>*;i/ 

[atJRa 2 ] ±BB«s©7 s >f i?9jum*Ko}£v bx b u 

£:*>;*-— 5 s -f *X b 'J-ASSIt«iSi:, 
±fa{55®X b U— ASfiOtftX b 'J— AhbT, ± 
83C5SIX b U — A i:±|3'J>& < i: *>;*-— 5 s ;*x b 'J - 

;^.yh©^|$©ft«^ffifflU^ ±13^7^ X b U 
-AWt-r-f^ b ')— A£^-5ry b-fb-TSCi:^ 

[W*i3] :r-f ^^;MI^-©tf<y bX b U— A&flF^ 

•fb-rsT^ ^^;Ki^^b^ati43v>T, 

a«©7*-r V*)\ja*<D\£v bX b 'J— A*g<i*-S3 

^©^-r i?^Mf-§-©tr«y bX b 'J— A©^-fb*(4 
T* ft S 7 * X J. - s> b © ^ £ $ t 3 - b* B$ SO i: 5 ft 
m-Tsrf -fe^i-y htftHi^Sfcx 40 
#^n-bB#giJ«lc, fc&SftfcSHR©^ bx b 
'J-ACtSCT^-fe^^-y b©*£££lt!BtbT, 

£^3- b'H^JCiS^TT^-feXJ-^y b©*££#± 
BjKR**ifc«*fltC« b< b U — A 

#>«?©^-f ^*;wa^©bry h^h'j-A^t<bts 

pgj::, 7^-feW=y b#±f3{fc^X bU— A©T^-fe 

b©*S££it£&^ht£s ±Cf*-fi>*-«/ 50 
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2 

«^-©t:^ bx b 'J-A©7^txa- 9 b ©;*;§££ 
±i3(g2®X b D— A©7?-t?X3.^y b©*£££©^ 

#sc:*tb-^ yvrt>rv hzm^-atrv bfb-r 

4 ] ±I3«2£©7^ 5>*;WB*DKs> bX b I) 
-A©#^«. fcT^X b 'J-AT-fe *K 

t**— 5*-f *-x b y-A&gfg-rsgftarpfc 

±§3X >r ^ ^©(i, ±f3SiS!X b 'J — A £<g© H 
t^X b U — A i: bT, ±fB{gffllX b U - A h±IB'J>& 

5 s >f*.*H;— A *JBWt\ 7*3— ^©tt 

IfiBSSOStf ^ v b ©:*:£ * U 

±K^f* Mb#©B\ ±885*3— ^©tfcl&tltfalXtf 

— A&lW— 7*-f 3"X b U-AWs; b-fbf^ci:^ 

[»*iH5] t*w ^^Mm^r^Bm-r^^ 

i&mo^-i v$mw. ! %<d\?.v bx b ■;— A^sit-rsx 

±H3«t&©5*^ WMm*%Wv bx b u-A©^-fb 
*fiLt-ftS7'^-feXJ--v b©^;t^h7 J 3-b*B#S!li: 

b•B#SlJStr^ t^iJti^tifcaiK©^^ VZfr\f.v 
bx b U— A©«IS©T^-fexa.-^ b©*t££jt$t 

mmtRz ntzmxmic^ b < & s «fc a t{gsx b — a 

iwim.^^ ispMs^cow bx b 'j— Atfffft 
-TS^Jc, ±l3r^-fex-a.-^ b* 5 ±fBiRSlx b •;— a 

©7^t^az.y f©AISCifc^J:|C, ±835* 
^^^;Wi^-©tTf bX b U-A©7^t7a-9 b© 
^&^fc±f3{5i®X b U— A©7^t^-s» b©yt# 

b^b-TSXgi:, 
±13*^?^^ >y b-fb^tlfea»©X b U-A£ lo©X 
b 'J — A t. bTfe^t-SXgi:4*f 5 Clii^^tiit- 
§7*1- isPM&^fcxklj&o 

m&m. 6 ] ±§3ffi»©7 ; -f vtMtwizv bx b u 

-AfflS-*«U tfr^b'J-Affet), 
'J>^< fcfe^-^-f ^"X b U-A^Sff-r^xgi:, 
±!3{5SIX b U-A^^Ctr^X b 'J-AhbT, ± 
§3(RfflX b »J - A fc±f3'J>5Sc < i: fe^-T 1 ^ *X b V — 
AJJIV^, 7 r 3-^©#t$&B#SiJS^^i' b©*# 

±13^^^ fftxgli, ±!37 : 3-^CDttil&BtSiJS^ 
yi^>> b©^;§-$©«^*MfflbTs ±§3tr^xbU 
— AStf^"— t 1 ^ 2l-X b 'J— K^f^fTv b-fb-TSCi:* 
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(3) 

3 

^©7^ ^;t/{i^©tf * hxh U-Aftgfi t^i 
±§3iS»©7V ^^;Ws-t©t:>> bx b v—&(Dftmb 
fttfc£t}-r§xfli;, 

£-^:3-bB#£iJ«£, ^tB$nfea^©7=-<^^>bf^ 10 
b* b y-ACffl&OT^-fe^Jx^y b©*§£ftJt>gt 
bT, r^-tex^y b©«*fiift;iIiR-rs:r*li:> 

mmm.t<titzm*mfcm b < & s <t ? cisas* b y - a 

±«3*&©t^ ^*;i/{i^©t^y b* b y-AftfS^ib 
-TS^tc, ±!37'^-trX^.n^h^±§3M^hU-A 
©T^-feXJi^y h©*§£tC?j§fc:£^£:££, ±13^ 
^^;Mf^-©t:^ b* KU— A©T^-fe^^X— V b© 
7v§£fc±f3{g:®X b U— A©T^-fe^-=£.— !f b©*§ 20 
££:©M7>£*fbT.. ^jyV^VvY^m^X^T 

m&m 8 ] . ±mm.(D^ mm^kd tr b x b u 

— AC^-S-fci:, Kft^ b 'J-Af$D, 

5*-r *X b y-AftSfiTr-^xgi;, 
±ffi<Rffl;* b U— AftffiOlfT*:*-* b U-AtUT, ± 
IBiSSt^ b U-Ai:±I3'i>^< fcfcsi— 7*>f b U — 

ASfflw, ^n— ^©gtimsimiF/^-/ y<d*l% 

SftJterraxgfcft^U 30 
±B/^f fftxfili, ±13^:3 -^©ttljt&BSM&tf 
b©*SS©««fttefl!bx\ ±I3tr^^bU 
-AfiW-r-f« b 'J-AS^'y bttrTS-^ft 

[0 0 0 1] 

a, tmmw&kiz, mm&m^&wgwm^&}z*fc 
x, ztiz&mv, ^tsi^^tffl^tsfa*, 

[0 0 0 2] 
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4 

^©fcaiS&fttf-bT, ^*i£©<i-if ftfe&U S^sffiO 

*ft&©flreftg«u a^-rs»-&a:^i£*v^ 

5MPEG (Moving PictureExperts Group) j5&X'$f 

[0 0 0 3] ±I3MPEGi:(i> ISO/IE 

C JTC1/SC29 (International Organization 

for Standardization / International Electrotechni 
calCommission, Joint Technical Commitee 1 / Sub Co 
mmitee 29 : S^^b^*/H^S»,«*^il. ^rll 
WSI^ l /m?*l&£ 2 9 ) ©g^ffll&iiifS^-^b© 

mttm<D«&foX'ib mp e g i mmt b-tisonrre 

ifi^ MPE G 2m^t bTIS013818#£>3o £*l£©B 
^Jptc43VNT, ^T^T^T^fifbCJHBT-ISOlll 
72-1SVIS013818-1AS, BMfe<Z)£ BT* I SOU 172-2^ IS 
013818-2*s, * fcW^CDSI B X IS011172-3,&tFIS013818 

[0004] if, mm.h^&mmiz®io<DX'. -m. 
h***?*— ^fc^o&sft©^— *ft*j:«>T (#« 

YbbT) fB^-fe^-rSo fit. ^ 
Kfb^ftfe^-^ft, B^fi^^W^hOofe^- 

*©«a»ifc^*bfc«a^b-r» *fte>©7*— *ftn 

[0 0 0 5] T^-^ft^fifbTTi.*^ J3r£©«©8Mfe 

-A##»b£ft£„ 

[0 0 0 6] MPEG^rA (IS0/IEC13818-1 &3 
^fc£ IS0/IEC11172-1) ftt, dCD^fiYb^b'J— Aft 
bt^5. felTC d ©M P E G i'X f- A iZ&if S 

3 _ yejtjvjs&.v&WAhx b U— A©flligtov^Tltt 

B^-TS. C^T-ttKiB^ftffi^t-r?.fc«)MPEG2 (IS 
0/IEC13818-1) T-D^^AX b U— ZJ3«fctfMPEG 1 
i^X^A (IS0/IEC11172-1) Xb'J— AHo^^T^S 
*s x MPEG2<>XfAfflb7>X#-hXh l J-A 

(IS0/IEC13818-1) *>MPEG2 /D^7A^ b 'J — A 
£ |1I«©SS iC <fc !) 7 s 3 — b* ? ^ 5 o 

[0 0 0 7] MPEG^rAflt (S^^^n— ^ 
©^B^l/ (STD : ^rA^-yvbrn-^) 
^^ntV->T, ^Ift->XrA^h'J-Ali, iCDST 
D^i3V^TiEb<, "TJS:t>*^y7rCDfflaeftSfc$3& 

[0 0 0 8] CifCfflSTD (^rA^-^^hf 
3-^) ©KrftsftKHB-r*. I6!iSTD (^-X^-A^ 
©-^J©«lBS«fiKft^b> 07 

(A) (B) (i, MPEG2->^rA©7'Dy7A 

X b y— AC«MVMPEG2 b^>X^-bX b »; 

— A©«jift-tii-en^-r. 

[0 0 0 9] STDfcfcrtgPii^^A*^ 



(4) 

5 

( S T C : System Time Clock) 1 6 tm£tl2>&^ 
LTV^So — JMPEG2^rA(Z)7D^7A^ b U 

77l/>^ (SCR : System Clock Reference) fcBfii 

KSftT^*. T3-^iiSTCtfSCRfc«b<S:5 

©^ijMi^ fesu-h, ^fefr^/W^y^© m 10 
ux_rate field £ :n>;3 — K£ftT^affiTR»tU"fo 

1 2*t-f>ft^f7 7 1 4fclA;fcf£ft3» 

[0 0 11] 0 7 t^ti^i^ 

— 7 s >f >^UX^>7 (DT S : Decoding Tim 
e Stamp) , : ^3 2xX#>7 (PT 20 
S : Presentation Time Stamp) fcWiiX^KFHfS«S 

b) ©^3— Ksn«^s^aB^a^sn5^§«f*jft 

*nS^S9S*bTi5!5> DTSBu T^-feX^-^b 
#«^Sft4B##J£;SUTV^- fcSU DTS = PT 
S ii&ST^-k;*^— *y bfcoOTte:. PTS©!^ 
:n>:n— K£ft£o r3-^f 7 7 1 2CA*Stlfc 
T^-fcX^— y HiU <r©STC©fB#DTS©fik:^ 30 
K^o^i:§tcM^77^?)§l?^nt#f3- 
£\ tm^rtr3-y 1 3^-r^tr3-^ 
1 SfcrA^ft^n— F£ft5o 

[00 12] dOD^d^STD (S^X^A* — ^^br 
3-^) C*^Ttt. Bltatip«fW-STCl 6fcJ*-T* 
^3— FWf*J©flMR^ &^W>*U — XbU-A© 
yl>Jr-/ hCx>3- K£ftTV^£fc«^ IfT^ 7 s 

[0 0 13] ^Sfbfc^TBU C©STD©# 40 

oil/^ >^ U— X b iJ-AOr3-y;^77#*-^ 
— yn — jScfc^TV^— 7D- b&V^id^, STD^ 
<D/*ytr<D&1femmSCR (^rA^O^^ 'J77l/ 
>X) #8^**1^ 7^Ma-ybSWvbftt5 
d£:#S;R£ft£o --T% ±13^"— 7D-klt 
;t^ 77 t^Sn5r-*#^v77Si6jBitb 
^:«SftU 7>f-7U-lt T^-fe*^—* 

b # 7 s n - b $ ft 3 ^ £ B# SO £ ^ t y y 7 lz * £ f ij » b T 
v^v^^^^fo ^©J:^*^— K^F©yty7r© 
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S-fr&^cfcdfc:. gf&CDIfy b* b U— A£^aftrT£ 
ft**, *{*W«AB:, 5feC«f«¥ 7-3 4 1 9 5 1^ 

[0 0 14] £l±Hu 0 7 CD (A) 0MPEG27P^ 
7AX b U— A£o^T©l£BJ3T*&S#> 07© (B) 
©MP EG 2 b^>^#— bX b U— A£o^T&[i]« 
tem^Fr^o 07© (B) ©b^>^5K— b* b'J- 
A^y^fcfc, ±|BIS0/IEC13818-UC*5V^'ra«afft4. 
HMB'W b (syncjyte) frbMMjJtryP (continui 
ty_counter) it*©4;W b©Cht*fe^o 
7:rl/>*;ftlF^:3— m*!ttx HI 7© (A) ©MP E 
G7P^7AX b U— A©»-&tHI«"tfft4. 

[0 0 15] MPEGifrttliGOP (Group of Pic 
tures : tr)\,— 7*zrW?-*) fcV^flliitfS !K Z 

1-S©^iu©GOP^Ht"^t:^^^§i^5i:b5fcv^J; 

»©tf7*^bU-A****^ GOPfttB!>#*.©* 
tilt LT»© b^** b U — A£«J D #A S d ^ 

[0 0 16] V>3u ±IB©*m -r*fc*»tf^XbU 
~A^GOPT*^CTV^^^^4 1 T^>=^-b^ftTV^^ 

2as©s^^7o^7Ax h u-Atffeot^ ^e*ve 
^A^bu— ACDta^w^s^rtefc-rsfc*)^ gop 

©«E|jWl3l— ©tf^r^v^y h^te^StiZZ titter 

[0017] i8it coi^ft^ffta^rn^ 
ax b u— A<3D*ft j eftftifta:t:*«ib , r«»^'©wa 

^©2ooD7n^7A7, b 'J-A*llRWMDftt 

Tfe^3^©#i£^LTv^o 08© (a) tc^-r 

£*5fcU 7D^7AXh'J-APS0©^^^PK0^ 
;^y^PK 1 ^Ztr^X b U-AVOOGOPO©?- 
ZhK 7 B o^7AXb'J-APS0©;^^PK2M 
^^PK3C If V 0 © G 0 P 1 ©t^— * #^B{b£ 
ftTV^^o Sfcs 08© (b) £^£-5 7D^7 
A^b'J-APSl©;^^PK0 N PK1 N PK2&C 
IfrtVlODGOPOCf-^^ 7D^7A^b'J- 
APS l©/1y^PK3kHf^*-V 1©G0P 1©^— 

^^mft^ftTv>?,o 

[0 0 18] Cft£>©08© (a) , (b) Iz^TXo 
Wi:^ift^tlfe2*©7D^7A7 l b »J-A# 1 

o©B«a«*fci3«i*iiTv^T, #jx.(£0 6©§b&$is 

1 O^Wt/D^A^ b U— AS^^y^#(ft"t-tW 

DSiTm^t-sct^ss^^Asas-rii: 

C«kD* t°p^^AX b U— Afe«ID#iL^K:*v^"t«I 
[0 0 19] 08© (c) tc^-Tcfcd^ 



7 

y^A* MJ— AP S 0<Z>/W*PK (K PKl£Kc£* 

itSLfcgL iltj-T^'Py^A^ HJ— APS KD^y? 

PK3£^{iii±J£ N i60t:r^^77 1 2 ttt % 

bT^VOCDGOPOCD^—^tfAA^ixfe^ 

V 1 ©G 0 P 1 ®r-^tfA*§tl§<Z)T% tr*V0 

U-A^iB^f^^lB^^nT^^iiUfcA 5 . 2#feJLfc 
Xbm&X&Zo WTCin?>^GOPc5Dt33#X.^CD^^ 

[0 0 2 0] 

j, ij— ^ > h^^V^T^tB-r^O^^A^ 

k u - a ^i^jciso t) #x z>mm*#f^ x ^ s t 

ct o 

[0 0 2 1H61. SCR (^fA^o^ij77 

(gWV'W 3 — KStltV^SCR) ^ (mJCD 

y^^^^oi>3— K^tiTV^ S CR) + (|rjy^^^© 

/^^^{cai>3— K£ftT^£ SCR) + (flu^y^CD 

^h'J-APSO^y^PKO, PK1, PK2, P 
K 3 , •••fc«Ctt*ffit-»^Ctt±fa©*f*tfJ«?) 

oJ;5£^fifb;**vrv^) , msco (c) fcsvrj;? 
fc % rP^^h'J-APSO^^^PKO, PK 

Xh'J-A^()MT, 7D^7A7b'J-APSl 

0^^^PK3 5i^ajbtr3-ytA^ii:a^t 
-aps l(Z)^fi{b^i^n-€ p n?^^^ffctLTv^^cz) 

^v?&mfrBt)^tzt£lC, STC (^XrA^^fA 
0>XrA^n^^>j7 7l/>7) 

[0 0 2 2] Ifi 2 , >y y 7 
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[0 0 2 3] C1CDSS2&, H9S#jHu&#&i&iii3-r 

c5*S©31i^&abt:v>5. CICIT-E19© (a) «u #1 
£(£128© (a) t^n^7D^7AXh'J-AP 
SOS^-v^PKO, PK1, PK2, PK3, -tm 

3|-VOfflGOPOOf-^, (-f) litrtVOOGO 
10 Pl©r-^T-fcS. E19© (b) #1*8:13 8© 
(b) lC^-rj;-5^7'D^^A^ h 'J— AP S 1 fc/Vy 
^PKO, PK1, PK2, PK3, — fcJIIiC^frtJtSL 
f;^^70«lt-fc!), (^) fihf^V 1©G 
OPOfflr-^^ (x) litrrtVlOGOPlOr- 
H9© (a) , (b) fc&fc, ^n^ft*^ 

M(Si8© (c) C^-Tid^ ^SlSS^T-D 
20 y5A^hiJ-APS0O;t>^PK0, PKU^ 

APSlfflMi»7PK3^gi:t5i:, ;^7ri: 
fcfc tf ^ V 0 © G O P 0 (D^r-*? ifi A7J $ ftfc^ If*** 
V l©GOP 1©^— *i 3 ©T?> ;^77(D 

c5#»©S^iix 12 9© (c) ©<t-5tc*So 

(t) litrr*VOC9GOPOOr-^T-fef)« (#) 
tttr^-v l©GOP 1©^— ^T-&£„ 

[0 0 2 4] Er^Vl©GOPl©r-^ST3-K 
iTZtglC, ^tbbfcfcSCR (S^^A^Dy^ 7 
30 Tl/>^) fC<toT, ^y7 7*»e>©5ltfe#fcfcDTS 

(r3-r-f>^-fA7>^>7) C<toT^ 5s 7 s 
-*©A:*j*«fctf§ISftS*-f (£) fcRWfc 

&5©T-> 19© (c) ©J;acn^770t-n-7 

[0025] ±iBbfcmiuc**T&sftfc 

&©-??& 7^t7,iz'n©iftg^-f >^ 
-^©^3 - K Jtifet©^ 97? ©ttl^Stcro ^ 
7A^ hU— Atzov>Tl5lbJci-^cii:lc < t t)s «$j© 
7o^7A^ b >J— A£:n> b »;— > h£:fcV>T12J 
40 9#*TmfrtBbfc£:£fc> SCRC^S^StS 

^ 5 A 7. h U - A £ £fi8 b ft 5 «fc *> tt. 7 4 V Z 
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